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DSVELOPMENT OF THE MODEL ACCOUNTING PLM 

As educational programs serving handif*,apped persons have increased in 
number and in size, the burden of ensuring prograia effectiveness has become 
heavy. Federal and state demands for greater accountability of operations 
evidence growing concerns that special education programs may be falling short 
of their aims. These sorts of demanas have led in the past to various program 
monitoring requirements, and it is likely they will foster refinements and 
expansions of extant data systems. However, the critical link between 
monitoring and the improvement of special education programs has not yet been 
forced. For this educational area, more data will not necessarily mean better 
programs. It is only certain that, barring technological improvements, mote 
data will mean more work for schools. 

In response to demands for accountability and concerns that data 
requirements contribute to program iit^rovements* thcs office of Special 
Education Programs granted three-year support to the American Institutes for 
Research for Project MAP — Kodel Accounting Plan. Project MAP is designed to 
test a demographic system for monitoring the within-schbbl and pbst-school 
transitions of special education participants. Implemented at the local 
level, this system produces data to inform school-level decisionmaking. 
Moreover, the data that are produced can bs aggregate 1 for use at higher 
adiri ii?*:rative levels. This report summarizes the progress made during Year 
One of the project, it includes the description and results of piluL tests of 
Model Accounting Plan components, and it present- .<? the rf:sults of preliminary 
analyses of special educatic* expectancy measure. J. 
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Design of the Model Accounting Plan 

The Model Accounting Plan iamploy^s a demographic accounting frairtework to 
examine issues related to attainment and attrition in special education; Such 
a framework was first proposed by Sir Richard stone (1971). It has since been 
explored in relation to educational topics by McMillen and Land (1979) and by 
Russ-Eft and her colleagues (e.g., 1981). A demographic accounting framoWork, 
When applied to educational systems, estimates population stocks and flows 
(e.g., enrollments^ graduations, other withdrawals) through various 
system-settings (e.g., grade-levels, instructional programs) over time. 



The status of an account must be measured at two points in time§ 
separated by a standard period, such as a year. The whereabouts of all 
persons present at the start of the period must be known at the end of the 
period for the accounting to succeed. New arrivals to the system during the 
period, together with those persons present at the outset, who are continuing 
in the system at the end of the period^ coni^titute the starting cohort for a 
subsequent account. Similar to a system of national economic accounts, which 
integrates information on economic and financial stocks ahrfi flows (e.g.^ 
available monies, investments, returns), a demograpM^ ^<:ov:ntihg sys4^ 
^Pf^Med-to education integrates informaticn on population stocks and f4awg^ to 
des4£g4 he patter ns of educational performance and the ways in which these 
pattern s c hange-^er^-tJ:nte . 

The individuals included in a demographic accounting framework may be 
divided into categories, of states, based on descriptive infbrmatibn (e.g., 
instructional setting, employment status). A particular sanple, thus defined 
for demographic analysis, may be represented by the proportions p., where i 
desccT.be the various categories or states of the fraraework. A row o.'r this 



matrix (i.e., a row of p^'s) constitutes a vector of proportions and may be 
denoted hy V. 

Traiii^tibiv probabilities . Accounting for the movements of students into, 
out of, and Within special education programs, and following graduation, allows 
transition probabilities to be estimated. TranglMon probabilities measure 
the likelihood with which individuals^ ^ fldv e amo ng stafees of^ ^he system within 
the period specified . For example, given that students are enrolled in a 
Special Day Class, transition probabilities might be used to estimate the 
likelihood of their remaining in a Special Day Class, moving to a Resource 
Specialist Program or to a Designated Instructional Service, or being main- 
streamed the following year. The proportion of individuals moving from some 
state i at the start of the accounting period to a different state j by the 
end of the period are described by the proportions p The matrix of all 
these transitions, i.e>, the matrix that describes the transitions made by all 
individuals included in the account during the period covered by the account, 
may be denoted by the symbol P. 

In princ3pie, the computation of transition probabilities is a 
straightforward procedure. Transition probabilities are, siinply, percentages 
derived from dividing the total number of students in each educational state 
at the start of the period (e.g., SDC, RSP) into the individual totals moving 
from this state to other states by the end of the period. Figure 1 provides 
an example of how these measures are confuted using hypothetical data for a 
two-year period. 

Complexities are i icrodiiced into the confutation of transition probabil- 
ities when the variance in these rates due to factors such as age, type of 



Divide Observed Frequencies by Row Totals 
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20/100=.2 


P = 
7O/10O=.7 



Figare 1. Example showing how transition probabilities ax computed 
(hypothetical data). 



handicaps sex* and ethnicity must be taken into account, in this case, where 
comparisons of the Pj^j's indicate differences due to such factors, a subdi- 
vision of states in the accounting framework into more precise states is 
required. In a later section of this report, the tests that were used to 
determine the appropriate ieveis of precision for Model Accounting Plan 
transition matrices are described. 

Expectancy measures . In a demographic accounting system for special 
education, transition probabilities may be used to estimate the educational 
expectancies of special students. Expectancy measures af e-ifidiGa%OFS— o# 
likely educational attainments for particular ages (e.g., being maihstreamed 
by age IC^ being graduated and at work by age 21). These measures are derived 
from successive multiplications, or powers, of the transition probability 
matrices. ThesiB multiplications start from a base year and continue for one 
or more yea<:s into the future. For exan^le^ for a particular sample of 
students characterized initially by the vector the proportions of students 
expected to be in (the) various states after n standard periods is given by 
VP'* — their distribution at the start, multiplied by the matrix of transition 
probabilities successively multiplied for n years (or raised to the power n) . 

Ideally, transition rates would be empirically determined for pairs of 
years covering the entire period of interest^ and expectancies for this period 
would be determined by successive multiplications of these rates. However, it 
is possible to estimate expectancy measures with less than complete data on 
transition rates. If, for example, the transition rates presented in Figure 1 
were valid for one-year-to-the-next projections for a number of years into the 
future (i.e., they remained constant for pairs of years during this period), 
successive multiplications of this (same) matrix would be sufficient. 
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Expectancies formed from such a simplified scheme aire said to be derived from 
single-stage trmsition probabilities. Of coarse, the assumption that transi- 
tion rates are stable for the period of interest is subject to question. It 
must be tested before the results produced by such an approach can be taken 
seriously. 



Year One of Project MAP aimed to derive single-stage transition 
probabilities for selected special education jurisdictions and to estimate 
.educational expectancy measures on their basis. Project MAP focus includes 
post-school attainments as Well as measures of within-schooi progress, so the 
transition rates arid expectancies estimated during Year One of the project 
required the follow-up of graduated students in addition to those remaining in 
the school setting. Moreover, tests of differences in the transition rates 
for students of various ages, handictipping conditions, genders, and ethnic 
groups indicated that Ibhese rates should be differentiated by age arid type of 
handicap and interrelated in analysis by special programs. The following 
categor ic of activities encompassed work on these aims during the first yea r 
of t 4^-effort . 

• Ideritify exan^les of successful procedures used to track special 
education students through the school system 

• ^^©'iti^y ®3^amples of successful procedures used to track special 
education students following graduation from special education 

• Evaluate exist- ing data systems for use in a demographic accounting 
framework 

• Pilot test foiiow-up procedures for use with special education 
graduates 

• Conduct transitional analyses within one local special education 
jurisdiction 
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tChe first four of these categories are reviewed in this report section. The 
steps followed in preparing data for transitional analyses and the results of 
these analyses are discussed in the next section* 

Identification of Bxemplary Procedures 

Literature searches Were conducted during the first several weeks of 
Project MAP in the areas of (1) school demographic studies, (2) special 
education transition research^ (3) special education management information 
systems development, and (4) use of cbn^uterized Individualized Education 
Programs (ISPS). The results were uneven across the areas i but leads to 
potent iaiiy profitable contacts were revealed. These contacts were made« 
principally with researchers working in the areas of special education 
follow-up studies and computerized data systems. 

To ensure that noteworthy efforts were not missed due to the absence of 
published documentation, three at tenets wc^rc made to use established networks 
of special education information. First, requests for reports were mailed to 
Region IX transition projects. These projects are funded by the Office of 
Special Education Programs, and they are actively engaged in promoting the 
school-to-work jbransition of special students. Second, requests for 
nominations of school districts and other locally-based efforts for tracking 
special education (and former special educaibion} participants were made of 
representatives from state education agencies and vocational rehabliitation 
offices in various states. 

The third approach to tapping existing networks consisted of 
presentations to meetings of the California Special Education Local Plan Area 
(SBLPA) Administrators and the Calif brhia Educational Research Association. 
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FolloW-up mailings and telephone contacts with participants sacceeded in iden- 
tifying several sites in which attempts at improving stutlerit tracking systems 
were underway or Were being planned. Project HAP is now working with seven of 
these sites (i.e., SELPAs) , with total enrollments of more than 60tOOO 
students. Moreover, the project was able to identify and to meet with ah 
outstanding consultant as a result of these presentations. Dr. BTahcy Enell 
directed several studies of computerized MIS systems for special education in 
the late 1970s and early 198ds (e.g., Bneil & Barrick, 1983), and, currently, 
she directs information and evaluation services for one of the larger SBLPAs 
in the state. 



Evaluation of Existing Data Systems 

The Model Accounting plan requires extensive, census-like data oh 
students participating in special education. At a minimum, data are required 
on age^ handicapping condition, instructional setting assignment, and 
withdrawal from special education. In addition, data describins sex, ethnic 
background, and primary language of students should be available for 
supporting analyses. 

^.^i/en these data requirements, the principal data system considered for 
use in in^iementing the Model Accounting '^lan was the annual count of special 
education students. Conducted in December and again in April of each year, 
the pupil-count data collection is intended to inform administrators as to the 
enrollments of students in special programs, by type of handicap, age, and 
ethnicity. Either the December or the April count would have been suitable 
for development of MAP indicators. The December count was chosen primarily 
because it was felt that returning the results of MAP analyses to participating 
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jurisdictions by early spring would better serve decisionmaking related to the 
provision of pupil services. 

Two shcrtcomings of the pupil-count system for use in establishing a 
demographic accounting framework were immediately apparent. First, this 
system iu primarily concerned with active enrollees iii special education, with 
the consequence that little emphasis is placed on keeping track of the 
progress of sti'dents after they leave special education. In some 
jurisdictions, records for students who withdraw from special education aro 
deleted frcsi the database. In other jurisdictions^ updates to student records 
are made by writing over the original information, thus deleting any 
historical perspective on student performance. 

The second shortcoming of the pupil-count system is that it was naver 
designed to relate information on enrollments from one year to the next. Each 
time a count is taken, the current status of students is reporteid. Reports of 
changes in student status over time, e.g.^ whether the student moved into the 
mainstream program or rc;mained in a special educatibn assignment, are not 
required by the system. As a result, management information systems at the 
local level typically make no provision for relating student records from one 
year to the next. 

Further and morG detailed studies of the adequacy of pupil-count data for 
use in Project MAP were made based oh interviews with operators anr* users of 
the data system, at local, state, and federal levels. Horeover, first-hand 
examinations were conducted to ascertain the accuracy and the currency of the 
data reported for the pupil-count. These studies were necessarily limited in 
scope, but they revealed problems worthy of attention. 
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In terviews ^tfith opega44^^-an4^^us€^ of-^ypj^-ee^ Adminstrators 
and data processing staff persons were interviewed in seven California Special 
Education Locai Plan Areas (SELPAs)» the local jurisdictions charged with 
operation of the state's special education programs. These SELjPAs are located 
in both the northern and southern parts of the state » and they cover urban » 
suburban, and rural regions. Interviews were also conducted with state 
represrantatives of special education programs. In ibhese sessions ^ local data 
collection procedures were ddcumehted, as was the incidence of state-mandated 
changes in these systems. The perceived infdrm^itibn heeds of local and state 
administrators were considered in relation to the products of the pupil-count 
system, and respondents at both levels were asked to comment on the usefulness 
of pupil-count data for (decisionmaking. Threa categories of findings emerged 
from these contacts. 

• Interpretation of data requirements varies across jurisdicticns and 
leads to the use of different criteria for determination of eligible 
students 

® T^f ?"??^?*^^ 9^ centralized data systems^ Which require considerable 
®^f9?^?_9"^_t^® P^^*^ local administrators, lag behind current 
classroom counts of students 

• The results of pupil-count data collection efforts are little used 
locally; they typically are not used for any purpose other than to 
conform to the reporting requirement 

To assess the geheralizabiliiby of these findings from the California 
sites, interviews were conducted by telephone with representatives of the 
federal Office of Management and Budget and with OSEP»s Division of Assistance 
to the States and Division of Innovation and Development, Special Studies 
Branch. These discussions also were of considerable use in gauging federal- 
level perceptions concerning the quality and usefulness of pupil-cbuht data, 
the findings did suggest more widespread problems With the annual pupil-count 
data collection, revealing that local-level inaccuracies may be magnified when 
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data are aggregated. At present, the pupii-coont reports from some states 
are of little use to federal officials in any serious review of program 
performance* 

Examination of wpil-co unt data . First-hand examinations of data cbiiec- 
tion procedures, database maintenance and updating schedules, con^literized 
files, and printed reports were carried out in two SELPAs. The findings from 
these examinations were followed up in interviews with data entry and data 
processing staff persons ^ to pin-point the possible reasons for problems and 
to elicit possible solutions. In one of these jurisdictions;, con^uterized 
student data were compared tro the paper forms from Which they were transcribed* 
In this same setting, extensive comparisons of enrcllment and discharge dates 
were made to evaluate the accuracy of data entry and updating procedures and 
to assess the accuracy of reported pupil-count inf ormetion. The results 
suggested room for improvement; discrepancies were found in th^ reporting of 
pupil-count totals (e.g.^ differences of from 10% to 15% were found in tb^ 
totals as originally reported). 

At an operational levcil, sevec^jr fihdihg^^^ronHtM limited investip^ation 
relate to processing or procedural deficiencies . These are listed below. 

• Students who are expected to be enrolled in special education (e.g., 
students from a lower-grade "feeder" school) may be automatically 
enrolled at the higher grade level. The status of these students 
must be reviewed and their records removed from the file if they, in 
fact, do not enroll in special education. Sometimes, the review of 
these records is not completed in time for the December pupil-cbuht, 
however; and the students are counted incorrectly as special education 
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enroilees. Even more seriously, these students may continue to be 
•'ehrbllei" and counted as active in special edacation for several 
years i because ho updating of the records is required. This problem 

be-ellmihafeed ^f Hi p e rio di<s checks of the database (e.g., for 
scheduling an nual^E^iei^) are reade^^-ro ''regular** and special 

education data systems are designed f^g^ compatible pTOeessi 
enabling cross-checking of information on student records . 

Updates to student records (e.g., recording a change in instructionei 
setting) are tint made acebrdihg to controlled procedures and may, as 
a result, introduce spurious enrollment or withdrawal dates ^ du€5 to 
entry into inappropriate fields. Moreover, errots detected in the 
update to a student record during the updating session may result in 
the creation of a spurious transactional record. Such a record might 
show that the; change had been made and then deleted on the same 
date. These sorts of errors, made during the processing of student 
records, surface when attempts are made to track students' progress 
through special education by merging student infoirmation from several 
files. Inappropriate "change-dates" or incorrect enrollment or with- 
drawal dates that have been added to resulting merged student records 
must be corrected prior to analyses. The solution to this problem 
may li e- i^ the develoiament of software "work-aids," such as 
edi t - ch e ckirig - data e ntry t e mpl ates i which would be designed to 
cores ide-with-^he primary appli^atiohs-sbf twares . 

Different identification codes may be assigned to the same student 
following his or her move to a new school in the jurisdiction. In a 
similar vein, ambiguous withdrawal codes may be assigned to student 
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records to allow for efficient re-^ehrbllsnents at a new school within 
the jurisdictidh (e.g., in cases Where use of the correct withdrawal 
code woald cause the re-enrol Inden t process to bo delayed pending 
transfer of student records). In both these cases, the requirements 
of data proce.ssing systems conflict with the neec* to deliver services 
to students in a timely manner. Resolution of such conflicts depends 
Updri (l)-ca# QfUl planning s essions involvinp both special educators 
and data procwsing st Mf^H^ersen s^ ehf creed ad he rence to 

a&reed upon procedureyj and^ieadlines (e.g^^, for submission of data, 
return of preliminary counts) . 

Pilot Test of Follow-Up Procedures 

Follow-up studies of participants in special education have been 
conducted to inform research oh post-3chobl experience (e.g., Hasazi, Got^ :a» 
& Roe, 1985; Has&zi et al., 1985), the transition process (e.g., Edgar eib al., 
1985 & 1986), and educational program performance (e.g., Mithaug & Horiuchi, 
1983). Moreover, considerable pilot testing of fbllow-up instruments and 
procedures was carried out during the past two years by researchers at SRI 
Interna tibnal, as part of their work on design of a longitudinal study of a 
nationwide san^le of handicapped students. This design effort, as well as the 
study itself which is being organized, was sponsored by the Office of Special 
Educ£.tion Prdjframs. Iri planning for the follow-up conqpbnenib of Project HAP, 
these efforts, tlie fdrms, materials, and reports they generated, and the 
shared experiences of the principal investigators were all of considerable 
value . 

Unlike many of these efforts, however, the Model Accounting Plan aims to 
build the foilow-up activity into ongoing school- or SEtPA-based information 



gathering prograius. Research support staff will not brdinerily hCi avaiiablt-^ 
to schools and SBLPAs utilizing the MAP system, and bu<l<jets for collecting, 
storing, and analysing masses of foiiow-up data are not likely to be available 
at all. For thes;e reasons, the scope of the information bo be collected via 
foilow-up surveys was designed to be rrtsximaHy informative to school personnel 
withbui. in^osing undue burdens. For example, only graduates from special 
education high school programs were included as survey respondents, and the 
^.elophbne procedure allowed information ho be coiiected from anyone at the 
household who could describe the student's current status with respect to work 
or continuing dducat;on. 

The succ3sses and needs of all Sraduates from special csducation programs 
are of concern to local program administrators. For this reason* nil graduates 
are to be contacted as part of MAP follow-up activities (i.e., no sampling is 
allowed), and repeated calls t^ worKirig telephono numbers are to be mad*, until 
contact is established. Moreover, f^rocedures are being established for deter- 
mining likely differences between nonrespondents and respondents to the survey 
from analysis of schooj -based data. Thes^ procedures, which are necessary for 
ensuring that proper interpretationss are made frdin the data^ are being designed 
for use by individuals* with only limited experience in research methods. 

Filb t-teat— si^fee . the formal Year One pilot test of MAP follow-up 
procedures was conducted in one SELPA, located in Northern Calif ottiia, with a 
total district enrollment of apprcxiinately 9,000 students at the secondary 
level; 1,09*5 of these students vere enrolled in special education during the 
period from December 1984 f:o December 198S. Approximately ii% of this number 
(122 students) graduated from special education programs during the period, 
and these students constituted the follow-up population. Sixty-six percent of 
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this population^ all but one Who could be contacted given iocntor inforradtic;i 
available at the district, responded to the HAP survey. In virttaaily ail 
cases (save that one) , nbnresj^ohdents singly could riot be found given the 
available locator infrrmatidn (e.g., telephone numbeij were incorrect or had 
beon previou'sly disconnected). These individuals ten<*ed bo be slightly elder 
than tha respondents at the tiuio of their graduation (e.g., twenty-eight 
percent of the nonrespondents were aged 14 years or olci^2^, <soiLpared to 13% 
of the respon*2ents) i arid they included a slightly higher percentajKe of ethnic 
minorities (thirty-^aven percerit of the nonrespondents, as compared to 20% of 
the respondents). Tha ty^.o groups Wcsre not dissimilar in terms of handicapping 
conditions or in terras of instructional setting assignments prior to gradua- 
tion, (biffarences between respondent ana nbhrespbndent groups were evaluated 
for statisihical sigiiif icwrice using specialized procedures--e.g. , PROC IMPOTB" 
developed by AIR staff. These procedures are discussed in the next report 
section. ) 

Reviews of MAP instruments arid trials of selected MAP procedur€ss were 
carried out in two other SELPAs. located in the ceritral and southerri parts of 
California, with total enrollments of over 45,000 students. Pesults from the 
formal pilot test and from these more informal assessments are presented in 
the following paragraphs. 

S urvey populatio n . The lack of enq>hasis on formal recording of informa- 
tion concomihg special education withdrawals complicates what should otherwise 
be a simple matter — assemblirig a complete arid accurate listing of the graduates; 
from special education prograas dtiring the previous year. The planned change 
in California's 1987 pupil-count forms , which will require counts of graduates i 
will nc doubt help this situation. At present, however, such lists must be 



coiapiied record-by-ref^ord, on thv5 basl^ of grade le-'ei, age^ and the absence 
of any withdrawal code other than graduation (<%.g., dropped school). 

Locator information for students in special educatlorn, wfhile somewhat 
more complete thatj for students in mainstream [programs, is neverthe):ess apt tcv 
be out of date. In this respect, the limir^ed findings from this first pilot- 
testing of KAP fcilow-cp pronedures cgrcs with thbss from the Sj^I design 
studies. Ptevicasly, it was noted that 34% of the students targetr^d a? 
participants in the MAP follow-up could not be contacted because of faulty 
locator information. In the SRI studies, 49% of the mailings? to students in 
special education programs, whose locator information war? obtained from the 
schools in which they #ere enrolled ^ were returned as non-deliverable because 
of incorrect address inf drntation. Moreover, in these studies incorrect or 
unavailable telephone numbers were found for 22% of the student san^le. 

it is noteworthy that in one respect, allowing for important differences 
in the mechodologies used, HAP findings are in contrast to there from the SRI 
studies. In one of their design pilot tests, SRI researchers reported a mere 
17% response; rate to a mailing requesting parental consent for study participa- 
tion (personal communication) . Perhaps because all MAP contacts with graduates 
and their families were made by telephone, by representatives of the district 
in which the student had been enrolled, virtually all studients Who could be 
found provided (or had provided for them by parents or relatives) data that 
were included in the survey results. A response rate of 66% may have been 
achieved overall, bit of those who could be located, the response rate was at 
100%! 
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Sarvey instrament . Four priniip?! information arsas Were covered by the 
MAP follow-up survey inshrutuent: 

1. Status with respect to high school graduation (e,g., whether or not 
he/she graduated from special education 

2. Re&pbhdeht identity and current locator ihtbniation (e.g., 
rbsidence/address of r^iSpor-dent and/or student) 

3. Job type and empioymeAt status (e.g.* full-Zpai-t-time, subsxdized/not 
subsidized) 

A, R^ucational status (e.g., full- 'part-time, school name) 

At the beginng of the purvey, items on agency assistance and vocational 
services received were it eluded; however, to reduce the time of the interview 
sessions., thei;*i^ items were removed from the forta midway during the survey 
trial We plan to streamline these items so that they may b3 itTiciaded in the 
second-year follow-up studies of graduates conducted by the project. The MAP 
. Year One survey instrument is contained in Appendix A. 

Project MAP does not require extensive infdnnatidn oh post-school 
experience. It is sufficient for the Model Accounting Plan that student- 
graduate status with it'^:pect to work and continuing education be assessed. 
Student accomplishments in these areas comprise two of the most important 
post-school "states*" or conditions, that an accounting framework must 
assess. Schools may, however* add other items to the survey instrument 
covering areas of particular interest, and although this was not atten5>ted in 
the first-year pilot-test, it will be an option for those local jurisdictions 
participating in the project in Year Two. 

Explaining the purpose of the survey to the respondents and ascertaining 
whether ah individual was indeed a graduate of the district, was at work, or 
was attending school* was easily accomplished once ihhe individual was 
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contacted. Ah interview session lasted between five and eight minutes. The 
distinction between subsidized and uhsubsidized en^loj^ment often could hot be 
made cleariy by the respondent ^ however, even ibhbugh various alternative 
wordings were available for use during the interviews. It is possible that 
the ego-sensitivity of these items militates against their use in interviews. 
In ahy case, the items relating to this distinction were omifcc;ed from the 
survey form after approximately the first twenty contacts. 

The first-year MAP survey ihstrument was designed using a ••multiple- 
choice" format, minimizing bpan-ended items. However, a right-hand column on 
each page of the interviewers' form was reserved for respondent comments. For 
many parents, the foiiow-ap survey was ah opportunity to communicate with per- 
sons and an agency that they had previously identified as a helper of their son 
or daughter. Probably for this reason, there was considerable ••volunteered" 
commentary from parent-respondents. 



Interviewers had no difficulty in eliciting responses, and they often 
conducted extended "interviews" because of the eagerness of respondents to 
relate problems, concerns, and successes. In more than one case, parents had 
praise for a particular teacher or for a classroom program their children had 
participated in while at the high school, arid there Were the inevitable 
requests for information and for continued assistance (e.g., ••How should my 
daughter prepare for the special education test at XX3CX community college?" 
"Where can my son find out what vocational training services are available?" 
'•We applied for assistance from the XXXX agency and were turned down. Where 
do we go from here?"). These indications suggest that, despite the many 
transitional programs and informational services available to the handicapped, 
many former special education participants would benefit from some type of 
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foilow-up or oatreach service, provided by an agency with which they are 
f andliar. 

Survey proce dur e s . iYie Model Accounting Plan depends on data collected 
and organized locally, by schools and school districts. For this reason, MAP 
survey procedures were developed together with SBLPA staff, and they were 
designed to fit practically into the schedules of full-time staff persons. 
Telephone contacts were made both during the day-time and early overling hours 
of weekdays. After several calls, however, the majority of the survey was 
conducted in the early evening (e.g., becween the hours of 4:00 p.m. and 6:00 
p.m.). 

The survey was conducted by a vocational services coordinator for the 
school district. He was assisted by one clerical and one administrative 
support person (the administrative staff person was provided by Project MAP). 
In many cases ^ his previous personal contacts with the students made the 
survey process ah interactive one, with respondents asking questions as well 
as answering them. If, on the first contact with the residence, it was decided 
a return call was necessary (e.g., the student-graduate was not at home at the 
time), the interviewer established a call-back time for completion of the 
session. In every case, contacts with a residence began with the interviewer 
introducing himself and explaining the purpose of the call — "to see how XXXX 
is doing now that he/she has graduated...". 

A variant of this procedure was recently tried in another SEtPA working 
with Project MAP. This strategy en^lbyed parent volunteers for two nights 
during the week to conduct the telephone interviews. With only minimal 
assistance from the project (e.g., sharing of Project MAP survey forms, 
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telephone and in-persdri cbhsUltatidns) , this effort succeeded in achieving more 
than a 50% response rate from all students who had left the district in the 
previous year — drop-outs, transfers, as well as graduates, in separate proj- 
ect discussions with another, southern California SELPA, this strategy of using 
parent volunteers was discussed, and it may be implemented iri that SELPA during 
the spring of 1987. At present, procedural materials to support efforts of 
these sorts are being developed by the project. 

The locator information provided by school district records Was often out 
of date. As a result, local telephone directories and information services 
were used. However, even these resources often were not useful. It Would 
seem that^ for many of the special students and their families included in 
this sample, the months following high school graduation were a convenient 
time to change residencv>s, to locations outside the comnuihity. 

When inte-Tview forms were completed, they were coded for analysis by 
project staff. In cases where the comments sections of forms included 
specific requests for information or other assistance, these requests were 
summarized on different sheeibs and returned to the vocational services coor- 
dinator at the district for extended follow-up. Seven specific requests for 
assistance were accbrnmodated in this manner. The summary results from the 
follow-up for the 66% of the population of student-graduates who responded are 
shown in Figure 2. For the Model Accounting Plan, the rates at which students 
moved from special education instructional setting assignments during their 
senior years to these post-graduation states were of primary importance. The 
development of these measures and of the complete transition matrices for the 
diffent age groups and handicapping categories are described in the following 
report section. 
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Continued 
48.4 




Withdrawn 
34.3 



Graduates 
17.3 



All Enrol lees 




] Neither 8.0% 
Soh'l Only 11.2% 

Soh'l/Wbrk 20.8% 



mrk Only 26.6% 



unknown 34.4% 



Graduates Only 



Source: Projeet MAP, AIR 



Figure 2. Summary foilow-up survey results for piiot-test site 
(n=122). 
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DSRIVATION OF TRANSITION PROBABILITIES 



the impact of any educational program can be described in terms of the 
transitions of children from one status to another (e.s-. from special educa- 
tion to the mainstream program or bo graduation). While each person's transi- 
tion has important individual characteristics, the entire set of transitions 
may be summarized in terms of the proportions of students who move from one 
status to another each year. These proportions are referred to as "transition 
probabilities." 

Special education transition probabilities are based on the movements of 
students into^ but of ^ and within special education programs, and following 
graduation. Computatibh of these probabilities involves dividing the total 
number of students in each education-related state at the start of a period 
(e.g., DIS, RSP) into the individual totals moving from this state to other 
states by the end of the period. Using the notation introduced earlier^ p^^ 
describes the proportion of those individuals iri state i at the start of the 
period making a transition from state i to state j during the period. For 
- example i if 40 of 80 students in a program graduate, the transition proba- 
bility for graduation from this program is 40/80, or .5. The matrix of 
P^j's, denoted by P, thus describes all transitions occurring during the 
period for the selected samples of students and education-related st ..ces. 

Derivation of such a comprehensive transitional matrix involves three 
fundamehtai decisions — which sample to use, which time period or periods to 
monitor, and which educajbion-related states to include. Following these 
decisions, the work is more painstaking than challenging, as it requires the 
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organization and development of an accurate » cbix^lete^ and up-to-date database* 
Finally, observed (and estimated; transition probabilities can be derived and 
combined to complete the accounting framework, preparing the way for analyses 
of expected educational attainments* 

S a ittpl e-gelec^ibn 

The Model Accounting ipian was funded with the primary intent of improving 
the tracking of individuals leaving special education prdgfains at the secon- 
dary level. For this reason, relating the in-«3chodl experiences and achieve- 
ments of special students to their performance in the worlds of continuing 
education, work, and independent living, was the principal aim of Project MAP 
in Year One. 

The population of interest to the project in Year One was comprised of 
ail students enrolled in special education programs from Grade 9 to 12 (or 
nohgroded) , as well as ail graduates from special education programs during 
the previous year* The age range was from age 12 to age 21, because at 21 
years of age most students must turn to agencies outside of the school for 
necessary services. Representing all the secondary school years in th^ sample 
ensured a suitably, broad range of experiences and achievements at this educa- 
tional level would be taken into account Iri subsequent analyses* Restricting 
the follow-up activity to previous-year graduates provided for the most direct 
estimation of in-schooi influences on attainments following graduation* 

One high school district, operating thirteen regular and special service 
schools^ served as the pilot-test site for Model Accounting Plan data collec- 
tion and analysis procedures in Year One* Located in a northern California 
Special Education Local Plan Area (SELPA), this district enrolls ripproximateiy 
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lylOO Special ediicatibh students blit of a total enrollment of aimbst 9,000 stu- 
dents. The student population, generally, comes from middle- to upper-middle 
class families, with median family income in 1984 ranking fourth out of the 58 
counties in the state at $22,390, and only 3% of the families qualifying for 
AFDC assistance. Ethnic minority group members comprise approximately 32% of 
the total student population, with the largest groups drawn from the Asian 
(15%) and Spanish-speaking (8%) communities. 

The records for all special education students enrolled as of December 
1984 and December 1985 were included in the Year One Model Accounting Plan 
analyses, and those students who had graduated from special education programs 
during this period (e.g., in June 1985) i^ere included in MAP follow-up activi- 
ties. "Graduatibh," for the purposes of this study, meant that a student had 
been officially certified as having completed all necessary work by the school 
district; no attempt was made to distinguish graduates according to the 
various standards for graduation thaf .aight have been applied. 

Of the total 1099 special students whose records and follow-up data were 
analyzed, the majority were males (63% versus 37%), the majority were white- 
Anglo (76%i with Hispanic sturlehts con^rising the next largest group at 12%), 
and the majority were learning-handicapped (77%, with the next largest group — 
Other Health Impaired students--coii^rising 7% of the total). Th special 
student's were approximately evenly distributed across Grades i-12, and the 
largest percentage were assigned to Resource Specialist Programs (approx- 
imately 46%). Table 1 presents these descriptive statistics. 
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Table 1 



Oegcription of Ri4ot-Test-5am^le 
(n=l,099) 



Sex 

Kale 63% 
Female 37% 



Ethnicity 

White Anglo 76% 

Hxspanic 12% 

Black 4% 

Other 2% 



Handicapping Condition 

Specific Learning Disability 75% 

Other Health Intpaired 7% 

Speech Impaired 4% 

Severe Language Handicap 2% 
Seriously Emotionally Disturbed 2% 

Educationally Retarded 2% 

Hard of Hearing 2% 

Other 6% 



Langaage 

English 87% 

Spanish 6% 

Vietnamese 2% 

Other 5% 



instructional Setting Assignment 
RSP 
SDC 
DIS 
Other 



Grade Level 
9 
10 
11 
12 
N6 



48% 
27% 
24% 
1% 



34% 
264 
21% 
18% 
1% 
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Selection of the Time Period for Monitoring 

In Year One, the Model Accounting Plan aimed to derive simple transition 
prdhahilities. This required data on student enrollment ftatus and post- 
gracuation attainments at two points in time, separated a standard perioc. 
of come significance to educatioral program administration. The period 
selected was on€5 calendar year, so that patterns of enrollment, attainment, 
and attrition could be related to single years of age and to annual planning 
cycles. 

As was described in the discussion of accounting plan development, the 
annual pupil-count was selected as the basic data system for use in Project 
MAP analyses. The data that are required by this system are, by themselves ^ 
insufficient for Model Accounting Plan analyses (e.g., they do hot require 
reporting of withdrawals from special education during the pieridd from one 
count to the next) , however they provide many of the basic indicators for 
these analyses. Moreover, the pupil-count system does provide the impetus for 
school districts across the nation to count the numbers of special education 
students currently enrolled in various instructional scLtings by age, handi- 
capping condition, ethnic background, and so on. In this way, it encourages 
school districts to develop more complete records for special education 
students and to organize these records for tabulation. Also, because the 
December and the April counts each year figure prominently in the determina- 
tion of federal and state allocations to local programs ^ these data collections 
encourage considerable regard for the accuracy of the totals that are reported. 

The December pupil-count data collection was selected as the focal point 
for Model Accounting Plan efforts, a decision that was made solely oh prag- 
matic grounds, since MAP database development activities and analyses might 
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have required from one to two months once the pupii-count data were made avail--. 
able, use of the April data would Ih all likelihood reiburh results to districts 
too late in the year for student-related programming or policy decisions, in 
contrast, data would be returned to dist:,"ictd no later than mid-February if the 
December pupil-count were used, a schedule that allows sufficient time before 
the close of the school year for examination of disturbing trends or reconsid- 
eration of individual cases In light of these trends. 

Selection or Status-Categories to Include ihr^ 

The technical discussion included in the original grant application for 
Project MAP addressed the selection of states ior the accounting framework, 
pointing out the needs for both (i) policy-informative grade-level equivalents 
and (2) indicators of various types of exits from the special education system. 

Grad^level eguivalenfcg . In contrast to Stone's examples of accounting 
frameworks for schools (Stone, 1971) * which were concerned only with deriving 
transitional probabilities at the most general levels Project MAP had to define 
more sensitive indicators of students* status within the special educational 
system. Where Stone relied on grade levels to track the progress of the 
(general) student population from one year to the n^xt, the Model Accounting 
Plan proposed to use instructional setting assignnients for special education 
students. 
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Inst;. actional settings are indicative of the extent to which students 
require special services (e.g.. as assignments to these settings reflect 
judgments based on the least-restrictive principle). Moreover, it is in terms 
of instructional settings or units that local administrators mist plan their 
annual budgets. In addition, the influences of instLiictiontil settings on 
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students' post-gradaation attainments are likely to be distinctive (e.g.^ in 
cerras of the preparation they provide for independent functioning or fuhctibn- 
ing without constant supervision). Finally, thene settings imply no brie way/ 
right way direction to the schooling ^^yerience — a special child is free to 
move among instructionial -giving assigniaents depending on his or her needs. 

Three types of assif.nments to special, education settings are rbutj.nely 
recorded for/ pupil-count reporting purposes — Special bay Class, Resource 
Specialist Prosram, an.d Designated Ins^ructiohai Service. The first setting 
is typically an all-day, contained classroom; the second typically involves 
one or two periods of specialized inehruction in general academic arnas (e.g., 
history, mathematics); the third is very ^specialized, oifering a particular 
service for one school period, such as specially designed physical education 
or speech therapy to students who otherwise function satisf «\ctbrily in the 
mainstream program. These three settings were included as states in the Model 
Accounting Plan. 

To carry out an rxccounting for a specified period, all individuals 
entering the system or who were present at the start of the period irust be 
located at the end of the period; that is^ the whereabouts of all of these 
individuals must be known. Because HAP laust therefore account for the status 
of all a'^txve special education students in deriving transition probabilities ^ 
two other states related to instructional setting assignments in special 
education were also defined for tha pilot-test site — Other Special Education 
Settir.i^^ to account for (the more sparse) enrollments in specipl schools and 
home instruction programs # and Unknown Soecial Education Setting, to account 
fov those special students whose assigned settings were missing from the 
database although they were enrolled in special education. Of the 1099 cases 

-28- 

37 



incladed in MAP analyses, Lwenty were classified as enrolled ir. an Oibher 
Special Education Setting and twelve were classified as enrolled in special 
education but in ah "unknown** setting. 

Exifcs frbnh the speeira]^ -education syscem . Students may move oat of special 
education for various reasons, and each of the paths that are foi lowed are 
important. Unfortunately, the ex' ent to Which these exiti: from special educa- 
tion are documented by local jurisdictions is less than complete. In some 
cases, records for students who leave special education may actually be removed 
from mah&gement information systems, making it impossible to trace why they 
moved or where they have gone. 

In the HftP pilot-test site, a rather complcste list of withdrawal codes is 
used to document exits from special education programs. For Year One analyses, 
however, it seemed prudent to combine these codes into a smaller number for two 
reasons. First, there were insuCf iciVent cus^s to make many fine distinctions. 
Sf*cbndi as these results were to be disseminated to other jurisdictions to 
encourage their participation in Year Two activities of the project, reducing 
the numbers of exits included in the accounting framework sitt^lifisd the 
analytic approach without diminishing the face-value of the rystem. 

Four exits fr:im special education Were included in the Year One Model 
Accounting Plan: (1) mainstis-iam/other jurisdiction, (2) drop out, (3) 
graduation, and at postsecondary school or work, and (4) graduation, and at 
neither school nor work. The first of these exits, mainstream/other juris- 
diction, included all special students who either moved into the full-time 
mainstream program or transferred to a school outsi^'e cf the jurisdiction. 
The rationale for including transfvsrs out of the jurisdiction in this category 
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was primarily an economic one — that such transfers represent ••t^'^ansf erred 
cbsts"--f roia special education jurisdictions to locai education agencies gener- 
ally. Out of the total of 141 students who were classi/fied as malnstream/cther 
jufisdictibri, 94 students Were originally coded by the management information 
system as mainstreamed students. The remaining 47 students were originally 
coded as transfers to other jurisdictions. 

the drop out classification included ail special students who were offi- 
cially classified as drop-outs, plus all those whose withdrawal codes indi- 
cated that the reason for their having been withdrawn was 'unknown." The total 
number of <!rdp-outs so-classified was 25, and to this number was added the one 
student who had died during the period. Graduates were all those students who 
had been recently enrolled in special education and were officially coded as 
graduates by the management information system, plus all those who had reached 
the age of 21 years and were no longer eligible for school-based services. 

This total of graduates, confuted based on MIS classification, was far 
smaller than the number of students that had actually graduated during the 
period according to local officials. This was found to be due to unofficial 
district reporting practices that allowed graduates to exit without withdrawal 
codes of any kind being entered on their records. For this reasong a listing 
of all former twelfth-grade students enrolled in special education Who were 
coded as not active in special education in the current year (but for Whom 
withdrawal codes had not been entered into the MIS system) wast niade available 
to school district personnel for their review. Based on these procedures , a 
total of 122 students were identified as legitimate graduates during the 
period. 
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These 122 gradtiates from special education programs constituted the MAP 
fbllbW-up population for Year One. Through the surv<^y of this population^ 109 
graduates Were found to be either continuing their education or working, with 
the remaining 13 neither at school nor at work. 

OrKanizing selected states into a ft^ewbrk . The initial framework for 
the Model Accounting Plan in Year One was thus comprised of nine status 
categories, or states, covering both in-school instructional setting 
assignments (five states) and exits from the special education system (four 
states) : 

• Enrolled in Special Day Class 

• Enrolled in Resource Specialist Prbgram 

• Enrolled in Designated Instructional Service 

• Enrolled in Other Special Education Setting 

• Enrolled in Unknown Special Education Setting 

• Enrolled in Mainstream/Other LEA Jurisdiction 

• Dropped Out of School 

• Graduated and at School or Work 

• Graduated and at neither School nor Work 

To visualize these states as part of an accounting framework, one should 
think of a nine-by-nine, or "square", matrix, with the nihe-by-nihe states 
defining 81 cells, each describing a proportion P-^y (The expectancy 
analyses described in the report section to follow require that for every exit 
sibate, or column in the matrix, there must be a corresponding entry state^ or 
row of the matrix — hence the importance of a square framework.) For any given 
cell, this proportion denotes the number of individuals who made the transition 
from one of the nine states at the outset of the period to another one of the 
nine states by the close of the period. Figure 3 presents the structure of 
this accounting framework. 
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Figures. Stnictuie of MAPaccounting framework. 
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Before data from special education management information systems are 
entered into this framework, however, adjustments should be made to the cells 
defined by the states describing exits from the special education system. To 
begin with^ although students may be expected to exit from special education 
by dropping but or by graduating, it is rather odd to think of students enter- 
ing the period from either of these states. In fact, graduates most certainly 
would not re-enroll in special education at the secondary level, and few if 
any drop-outs ever bother to return* 

To account for this constancy within state, it suffices to adopt the con- 
vention that once ah individual drops out or graduates, he or she remains a 
drop-dut or a graduate. Mathematically^ this is accomplished by setting all 
the pj^ associated with the drdp-oUt and graduate rows of the matrix to 
zero — save those that denote students moving from drop out to drop, out or from 
graduate to graduate, which may be set to one. Speaking in terras of probabili- 
ties rather than proportions, this procedure makes it certain that a graduate 
will remain a graduate for purposes of analysis, and so for drop-outs. In prep- 
aration for working With data from the MAP pilot-test sit€5\ such a procedure 
was followed. Figure A illustrates the results of this approach. 

Quite the opposite sort of consideration motivates preliminary adjustment 
of the mainstream row of the matrix. Here, while it is easy to think of the 
numbers of mainstream students who enter special education during the account- 
ing period, the "squareness" of the matrix focuses attention equally on the 
numbers of mainstream students (with particular handicaps) who drop out and 
graduate during this period. 



-33- 

43 



If, to complete this matrix, only data from special education information 
systems were used, the numbers of mainstream students who drop but, graduate 
and attend college or work, or graduate without subsequent college enrbllmeht 
or en^lojonent , would not be available, and the resulting proportions would be 
underestimated. To prevent this, drop-but rates and estimates of the gradua- 
tion and subsequent education and eic^lbyment rates of the general school popu- 
lation first must be obtained from local school officials and entered into the 
matrix. For the pilot-test site, mainstream enrbllmeht data Were obtained for 
each secondary school grade level, along with drop out arid gfaduatibn rates by 
grade level and overall continuing education and employment rates for graduates 
of the district. Then, because MAP analyses differentiated among three cate- 
gories of handicapping conditions (see the discussion below on the effects of 
age, handicap, sex, and ethnicity oh transition rates), these rates were multi- 
plied by the number of students with particular handicapping conditions who 
were enrolled full-time in the mainstream program. Figure 5 shows these data 
added to the accounting framework. 

PreparaMbhr^^f^ Special Education Data 

The source of infbrmation for individuals participating in special 
education programs within local jurisdictibns is the Individualized Education 
Program (lEP). The lEP, which mlist be developed fbr each enrolled student in 
these programs, contains demographic and prbgram-related ihformation, lEPs 
are updated at leasib annually, and any change in information concerning the 
student (e.g., different address, score on a more recent assessment) is 
recorded in the lEP. 

Mahy special education jurisdictions have adopted the practice of using 
parts of the IBP as source documentation for their management information 
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systeiQS. Whereas lEPs are usually several pages in length aiid may be kept 
together in files with other paper-copy materials pertaining to the student, 
portions of lEP information may be transferred to on-line, computerized 
systems or abstracted for easier access in desk files. Frequently, the "front 
page" of an lEP, that page containing student locator infonnation, program 
data, and datos of scheduled reviews, becomes the principal source document. 

On the positive side, use of IE? farms for managei^ient information systems 
ensares that source documentation will be provided to these systems for every 
enrolled student. SVo negative aspects, however, are that lEP forms may be 
poorly designed for data entry, and they may not be designed at all for the 
periodic updating of student records (e.g., upon discharge or transfer from 
the progrcm). For these reasons, special education MIS operations are usually 
better prepared for producing pupil-count summaries, although delays in report- 
ing may occur and totals may incorrectly include students who have already 
exited special education, than they are for providing longitudinal perspec- 
tives of student performance. 

The Model /^counting Plan draws information on student enrollments from 
the December pupil-count data collection. In addition, however, data are 
required on student withdrawals from special education (e.g., drop-outs, 
graduations) occurring during the period between the December counts for two 
adjacent years. These data on enrollments and Withdrawals from special 
education programs must be merged to create a usable data file for MAP 
analyses. 

Merge data files and assign flags . In the pilot-test site, a mainframe 
computer system operated by the county educational office manages the MIS 
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system for special education. Itifbrmatibr. taken from lEP forms and from forms 
specially designed to record changes in student programs is entered onto the 
system via remote terminals located in the district office. Data entry is 
carried out by district office staff persons who are charged with various 
administrative responsibilities relating to the operation of special education 
programs. 



Computer tapes containing information to support thn December pupil-counts 
are created and stored at the county office. In addition^ once each year (in 
July) a tape is credited cdntainirig information oh withdrawal^:! from special 
education. The December tapes contain student Ibcrtor information as well as 
program information, and enrollment, discharge, and review dates are included 
on thr. student records as appropriate. The July tapes contain the complete 
records for students who have withdrawn from special education during the 
previous year, and 17 codes are available to record the reasons for withdrawal 
on these records , 



The tapes for December 1984 arid December 1985, along with the withdrawal 
tape prepared in July 1985, were used during the pilot test. The files 
credited from each of these tapes included 16 variables: 

• Student ID Code 

• Special Education Status (c»;g., active) 

• Birthdate 

• Enrollment Date 

• Discharge Date 

• Discharge Code 

m Primary Language 

• Sex 

• Ethnicity 

• Handicapping Condition 

• Grade 

• Instructional Setting (e.g., SDC, RSP) 

• 4 DIS Service Codes (e.g., speech therapy) 
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Both Deceitibei* files were checked to ensure that all records were coded 
Stah4is= 2, or active in special education, and that no records contained 
discharge dates or discharge codes. Any records not meeting these criteria, 
and hencp apparently incorrectly included oh the filei were printed out and 
reviewed together with school district personnel. The July file was checked 
to ensure that all records were oded StatU3= 4, or inactive in special 
education, and that the discharge dates for each record were earlier than 
December 1, 1985 (so that the student was, in fact, a legitimate withdrawal 
from special education for the period of interest). When all inconsistencies 
had beea resolved (approximately 30 cases required some discussion, with 
two-thirds of these needing some recoding aiid the remainder removed from 
subsequent analyses), these three files were then merged by Student ID Code 
and Birthdate, and unnecessary redundancies were eliminated from the merged 
records (e.g., duplicate birthdates for a single record). 

Flag variables were then created and assigned to each record. These 
flags were used to designate the status of each student with respect to 
special education programs during the period of the account. The seven flags 
were defined using status codes and enrollment and discharge dates, and these 
definitions are listed below: 

• Active in December ±984 only 

• Active in Decf^mber 1985 only 

• Active in both December 1984 and December 1985 

• Active in December 1984 but withdrawn prior to December 1985 

• Active before December 1984, withdrawn, and inactive in December 1984 

• Active after December 1984, withdrawn, ah<', activ© in December 1985 

• Inactive in both December 1984 and December 1985 but enrolled and 
withdrawn during the period 

The seven flag variables Were en^lbyed in performing various edit-checks of the 
data. (It should be .loted that all file organization, editing, and analysis 
tasks were carried out using the SAS System, available through the Stanford 
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University Information Technology Services.) SAS is also available for IBH 
PC-Ai' coiq^uters. 



iPerform edit-checks . Two types of edit-checks were performed ox\ the 
merged file of student records — (1) checking for duplicate nainos and (2) check- 
ing for anomalies With respect to enrollmeat and discharge dates (eg., a stu- 
dent shown to be enrdllBd prior to December 1984 and to have been difjcharged 
after that date but not designated as "active" for the December 1984 pupil- 
count) . 

Project MAP provided assurances of confidentiality and received pBLmission 
from the pilot-test jurisdiction to work with data that contained student 
names. While student names can be removed from the data files without causing 
any problems for MAP analyses once edit-checking is conq)leted, they are useful 
in finding errors caused by student-movements into and but of the special edu- 
cation system. For example, a student who is enrolled and is subsequently 
discharged from special education will have a record on the MIS system. If 
that student re-enrolls in special education at a Is' ar time, a new record may 
K^istakehly be created. It may be that no query of system records vras made at 
the time of re-enrcllment , or that the student was mistakenly re-enrolled with 
a different birthdate, or that the student has used a different firjt name or 
spelling of a first name at the time of re-enrbllment . Whatever the particular 
reason, the problem is all too common to special education data systems. 

The list of possible data processing problems related to name-changes is 
quite long and difficult to predict, and the only solution is to print the 
complete records for students with the same family names and check each vari- 
able for posisible duplication. However ^ even this procedure is insufficient 
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in cases where students might change ibheir family names prior to re-enrollment. 
More stringent procedures are called for in cases where this event of family 
name-change may be expected to happen with some frequency (e.^ . in communities 
with large Hispanic populations * where students often change their family names 
depending on whether they are currently residing with their father or mother.) 

For the pilot test, only 28 cases of suspected duplicate names required 
variable-by-varJ.able checking. However, each of these cases was only resolved 
after discussions with data entry and data processing staff persons at the 
site. Resolution in these cases amounted to determining whether the names 
were indeed duplicates and whether the record information could be merged. 
Although such checking may seem straightforward* twins with similar names and 
identical student names with slightly different birthdates test even the most 
rigorous procedures. 

Edit-checkihg based on flags and dates of ehrolimeht and discharge from 
special education produced many anomalies and required the most time to 
resolve. Students might be shoWti to have been withdrawn prior to a December 
date but reported as active on that date. Similarly * students might have been 
enrolled in special education, re-enrolled and discharged oh the samo date 
some time later, and duly reported as active for next December's count. To 
find and resolve all of these types of cases, ^t was necessary to check all 
records with withdrawal flags — even those records of students withdrawn prior 
to December 1984 who were (correctly) reported as inactive in that count. 

All enrollment and discharge dates oh records i^fith withdrawal flags were 
printed out and examined; The complete record was printed for any case that 
appeared questionable, e.g., the student had withdrawn prior to December 1984, 
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as the flag indiciated, but had a later discharge date also recorded without a 
corresponding re-enrollment date* The liisting of all these questionable 
records was then reviewed with data entry and data processing personnel, and 
in several cases it was necessary to find the original paper records for 
clarification* Through this rather laborious process, which required almost 
one full month, each case was finally resolved (e.g., a questionable enroll- 
ment date was found to have been entered in error, as the student had never 
been discharged^ and this date was removcsd frora the record). Moreover, some 
problems related to the particular data entry and updating procedures used by 
the pilot-test district were identified, and steps were described to avoid 
these problems in the future. Several of these problems, which are more 
common to special education data systems generally, are summarized in the 
previous section of the report. 

Create status-variables and impute missinp values . Once ail the questions 
about individual records were resolved, 1984 and 1985 status variables were 
created for each record. These variables describe the entry /exit (or input/ 
output) status of each student as regards the MAP accounting framework. Stu- 
dents who were enrolled in either December 1984 or December 1985 were assigned 
status codes for each year in terms of their instructional setting aassignments 
for that year. Thus, a student who was in a Special bay Class in December 
1984 and in a Resource Specialist Program in December 1985 was assigned an 
entry status of SDC and an exit status of RSP. 

students who had withdrawn from special education during the period were 
assigned either mainstream, drop out, or graduate exit status codes (their 
entry status determined by their instructional setting assignments the 
previous year), and those coded as graduates were then followed up to 
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differentiate between those who were either at school or work fbllbwing grada- 
atibh and those who were not continaing their education or einpibyed at that 
time. Students who were hot enrolled in special education in December 1984 
were assigned mainstream entry status, and if they moved into special education 
by December 1985 ^ their exit codes corresponded to their instructional setting 
assignments at that time. 

Fbr the 43 student-graduates who did not respond to the fdiidw-up survey 
and whose exact exit status was therefore unknown, imputation procedures were 
used to determine whether they should be coded as graduates — at school or 
wbrk~dr as graduates—not at school br work. Imputation procedures are 
designed to make population estimation pbssible, by providing the most complete 
empirical basis for such estimatidri. One procedure ^ PROC IMPUTE, was developed 
by Drs. Lauress Wise and Donald McLaughlin of the American Institutes for 
Research in 1980, working under contract as the Statistical Analysis Grdup in 
Education to the National Center for Education Statistics (see, for reference. 
Wise & HcLaughlin, 1980). 

PROC IMPUTE is available from AIR for use through the SAS System. The 
procedure uses regression analysis td estimate values for variables for which 
data are missing from selected records. PROC IMPUTE determines a subset of 
respondents a nonrespohdeht is most like and assigns a value randdmly selected 
from the distribution of the variabie(s} in question to the nonrespondent 
record. For the pilot test, age, sex, ethnicity, and type of handicap were 
the variables used to identify respondents most similar to each of the 43 
ndnresponderits ^ in brder to impute responses to the question of their post- 
graduatidn status if they cbuld have been contacted. Based on this analysis, 
five nonrespondents were assigned to the graduate—not at school or work 
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category, and the remainder were asdignod as graduates—at school or Work. 
This proportion (approximately 12%) is in keeping with the overall results 
obtained from respondents, where eight persons were found to be not at school 
or at work following graduation out of the total 79 persons contacted (i.e., 
10%). 



Observed Versus Estimated Transitio n Proba bilities 

With entry and exit status codes assigned to each record, corresponding 
to the 9x9 states of the accounting framework, the probabilities p . ^ were 
derived based on thes observed frequencies. At this point, however, it becomes 
important to consider whether these probabilities are subject to influence by 
the age, type of handicap, sex, or ethnicity of the student population. Were 
age a factor in determining transition rates, for example, with older studcjnts 
more likely, say, to be mainstreamed, then projections of eventual in-schdol 
and post-graduation attainments for students based on these rates would have 
to the age of students into account. The method for determining the 

significance or these factors is log-linear analysis, which is based on 
fitting a (log-linear) model to observed cell frequencies. 

Effects of age^ 4ian4i^apnr^e3^. ah^^^ e^hhi^l^v . When a log-linear model is 
fitted to the observed frequencies in a table or matrix, the logarithms of the 
expected cell frequencies arft written as additive functions of main effects 
and interactions, in a manner similar to the analysis of variance model. The 
statistical significance of particular fac:.ors for determining transition rates 
is thus measured by evaluating performance of the estimated models with and 
without these factors included. If, for example, the variable age (specified 
by the interaction term IOA| or input/output status and age) significantly 
improves model performance (as measured by chi-square tests), then age should 
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be included in ibhe accounting framework; COiiverseiy, if removing the ihterac 
tibn term IDA does hot significantly reduce the explanatory power of the 
estimated models i.e., there is little difference in model performance with 
and without this term, then age could reasonably be excluded from considera- 
tion within the accounting framework 



A prior step in assessing the significance of age and type of handicap 
for the probabilities p^^ was to observe these probabilities by single year 
of age and by particular type of handicap to determine if patterns could be 
detected. Based upon this observation^ four age-groups were defined: 12-15 
years, 16 years, 17 years, ard 18-22 years. Within each of these groups, 
transition rates are comparable, while between groups there are considerable 
differences. In the same way, consideration of the observed frequencies by 
type of handicap led to the formation of three groups. Iri this case, however, 
not only the similarity of transition probabilities within each cluster but 
also the similarity in service requirements associated with the various handi- 
caps were used as rationales. This grouping of handicapping conditions is 
presented below. 



Orthopedic Disability 

• brthopedically Handicapped 

• Other Health Impaired 



Learning bisabiiity 



• Specific Learning Disability 

• Severe Language Handicap 

• Hard of Hearing 

Retardations or Severe^ Sensory Disability 

• Educationally Mentally Retarded 

• Trainable Mentally Retarded 

• Developmental ly Disabled 
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• visually Handicapped 

• Deaf-Blind 

• Deaf 

• SPf^S^.^^^ired 

• Seriously &notionaliy Disturbed 

• Autistic 

Log-linear analyses Were then run to determine the statistical significance of 
taking these categories » as well as variables describing sex and ethnicity, 
into account when deriving estimated transition probabilities. 

As a result of these analyses, age was found to be the single statistic- 
ally significant factor. Models cbi^rised of interactions involving handi- 
cai.pihg condition^ sex^ and ethnicity were significantly poorer in fitting the 
data when the interaction of age with input-output status was removed (i.e., 
the lOA interaction term). For exair^le^ the test-of-fit of the model based on 
age and handicapping conditidh as well as input-output status had an associated 
chi-square of 5, with 24 degrees of freedom. When the input/output status/age 
term was removed » the chi-square was 104 with 36 degrees of freedom. 

Even more dramatic results were obtained in similar analyses where either 
sex or ethnicity replaced handicapping condition (and the few cases without 
determinable ages were removed from the model — i.e., the "no age" category was 
eliminated). lu the case of ethnicity^ for example^ the model including the 
lOA (age) term had a chi-square of .6 (!) with 9 degrees of freedom, whereas 
the model without this term had a chi-square of 96, with 18 degrees of freedom, 
table 2 shows the chi-square values associated with various models. 

In some sense, the important influence of age on transitional status 
within educational programs is to be expected. Students are more likely to be 
graduated as they grow older, and it may be that learning disabled students 
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Table 2 
Chi-Squares Associated with 



Various Log-Linear Models 



Model Gfei-Sauare df 

Age and Ethnicity (OIA, OiE, lAE, OAE) .56 9* 

Age Only (AIA, lAB, OAE) .86 12 

Ethnicity Only (OIE, lAB, OAE) 95.96 18 

Age and Sex (OIA, OIS, IAS, OAS) .20 9* 

Age Only (OIA, IAS, OAS) 1.93 12 

Sex Only (OIS, IAS, OAS) 94.28 18 



Age and Handicap (OIA, Olff, lAH, OAH) 4.60 24** 

Age Only (OIA, lAH, OAH) 7.02 30 

Handicap Only (OIH, lAH, OAH) 104.06 36 



Four categories of age and two categories of ethnicity 
(i.e., white versus nonwhite) and sex. 

Five c^^tegories of age (i.e., "no age," 01? "missing age" included 
as a district category) and three categories of handicapping 
condition. 
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(that group coii^riising the largest percentage of the special education 
popuiatidn^ — almost 80% of the pilot-test population) tend to be mainstreamed 
with greater frequency when they are younger, with those who are not main- 
streamed at an earlier age continuing on in special education for several 
additional years. The results obtained from analysis of the pilot-test data, 
however^ do suggest ptrikihgly that any system of accounts for special educa- 
tion programs must differentiate among the ages of the students. 

In the same vein, vfhile these results did hot find handicapping condi- 
tion, sex, or ethnicity to be statistically significant factors in determining 
c?iangesi of status, these variables should not be dismissed from transitional 
analyses based on only these limited data. Ciearly* more studies of the 
effects of these variables on transitions in special education need to be 
made, with larger sample sizes. For Year One analyses, in fact, the three 
categories of handicapping condition were added to the accounting framework 
despite the iacfc of statistical significance. Too st'^ong a case can be made 
conceptually for the relation of handicap to transitional status, and the 
observed frequencies p^^ suggested different patiberns of movement among the 
9x9 states of the framework for students who were in each of the three 
handicap categories defined for the study. 

Using -observed^ v&rsus-egtim values in ana lysis . The decision to add 
four age categories and three categories of handicapping cdnditidris to the 
accounting framework stretches the limits of a relatively small data-set. As 
the number of cells in the transition matrix grows from 9 x 9= 81 to 3 x 4 x 9 
X 9= 972, the numbers of empty cells increase, as do the numbers of rows with 
fewer than 10 or 20 total observations. Under these circumstances, it is 
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dangerous to rely on observed frequencies alone in deriving transition proba- 
bilities, as they will provide very unreliable estimates. 



One solution is to take advantage of the results from the log-linear 
analyses described above — in particular, the estimated frequencies p 
produced by the log-linear model including age and handicapping cdtiditibri. 
These estimates are based on an overall structuring of the data (in terms of 
the various interaction terms, lOA, lOH* AHO, and AMI, where I=input, O=output, 
A=age, and H=handicap), such that the predicted value for any cell is deter- 
mined Ibhrough consideration of all the available data. (They also represent 
the assumption based on this data-set that transition probabilities ate not 
significantly related to sex or ethnicity, and that these probabilities are 
constant for each age grouping within handicapping condition.) Model esti- 
mates can be expected to be more reliable than observed frequencies for 
estimating transition probabilities when these observed frequencies are based 
on only a few cases. 

in MAP Year One analyses of the pilot-test data, both observed arid esti- 
mated transition probabilities were used in deriving values for the accourirJ;-^ 
framework* using a form of empirical Bayes estimation. Specifically, for each 
of the 3x4x9x9 cells of this framework, observed frequencies were used 
when the total for that particular row of the matrix was greater than 30. 
When this total was between 10 and 30 observations* the value entered into the 
ceil was the average of the observed and estimated frequencies. When the row 
total was less than 10, the estimated frequencies were entered. In this Way, 
the accounting framework was f iiied-in with the most stable estimates of tran- 
sition probabilities that could have been produced with data from this one 
SELPA. 
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The nine steps involved in carrying out development of the Model Account- 
ing Plan transition matrix are summarized in Table 3. As describ3d in the 
preceding pages* these steps represent the procedural phases by which raw data, 
taken from the pupil-count and MIS data systems of local jurisdictions « are 
transformed into a suitable database for analyzing special education transi- 
tions and expected attainments. 

Model Accoairt4ng-M.an -Transition^ One 

Based on the analysis of Year One pilot-test data^ the MAP accounting 
framework consists of a four-dimensional, 3x4x9x9 matrix, differentiating 
transitional status by type of handicap, age, instructional setting assignment* 
and post-graduation attainment. Figure 6 (in three pages) presents this frame- 
work. The observed and estimated numbers used in deriving these transition 
probabilities are presented in Appendix B. 

The transition probabilities presented in this figure describe the propor- 
tions p^^ , which summarize the movements of handicapped students among the 
various education-related states. If it is assumed that these proportions 
remain constant over time, showing only slight variation from one year to the 
next^ then the accounting framework may be used to project expected educa- 
tional attainments. These e3q>ected attainments, or expectancies, are the 
subject of the next report section. 
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Table 3 



Steps in Trauisforming Local Data for Use 
in HAP Accounting Framework 



1. Create data analysis files with relevant demographic and education status 
variables for the period(s) of interest. 

2. Check records on each file to establish that active and withdrawn 
students during the period were correctly classified. Resolve any dis- 
crepancies. 

3. Merge files by two or more variables (e.g., ID & birthdate). 

4. Create and add flag variables to each record designating the status of 
each student with respect to special education during the period. 

5. Perform edit-checks of (1) name duplication and (2) inconsistency of 
special education enrollment and withdrawal dates. 

6. Create and add status variables to each record describing entry/exit 
status of each student as regards f;he HAP accouhtihg firamewbrk. 

7. Inpute missing values for follow-up of recent graduates using PRGC lifPUtB 
(Wise & McLaughlin, 1900). 

8. Estimate significance of age, handicap, sex* and ethnicity oh observed 
transition rates using log-linear analysis, and confute estimated 
frequencies ba^^ed on fch** best-fitting model of these effects. 

9. Us«a obs-^rved and estimated frequencies to compute transition 
probabilities for every cell in the MAP accounting framework. 
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Figure 6. One-year-tb-the-hext transition probabilities, for the MAP 
accounting framework (based on data from one California SELPA—tdtals of 
probabilities across rows may not sum to 1.00 because of rounding). 
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Retardation. Severe Sensory Disabj>lity 
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Figure 6 (cont'd) . Ohe-year-to-the-next transition probabilities for the MA? 
accounting framework (based dri data from one California SELPA--tbtals of 
probabilities across rows may not sum to 1.00 because of rounding). 
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ANALYSIS OF SPECIAL BHUCATION EXPECTANCY MEASURES 



Expected educational attainments by a particular age, or educational 
e3q>ectancies, are derived from powers of the transition probability matriXt 
starting from a base year and continuing for one or more years into the future. 
For a particular sample of students^ characterized initially by the vector V, 
the proportions of students expected to be in the various states after n stan- 
dard periods is given by VP*^. 

For a single student of a particular age and handicapping condition, the 
initial vector V needs specify only his or her instructional setting assignment 
to start. In terms of the 9x9 states of the accounting framework, a one 
followed by eight zeroes designates this assignment as Special Day Class; a 
zero then a one, followed by seven zeroes, indicates a Resource Specialist 
Program assignment; and so o :o a vector consisting of eight zeroes followed 
by a one, indicating the student was a graduate — not at school or work — at the 
start of the accounting period. By specifying the initial setting assignment 
in this way, and using those portions of the accounting framework correspond- 
ing to the specific age and handicapping condition of the student, it is 
possible to project educational expectancies for single years of age up to 21 
years. Table 4 (in two pages) presents these expectancies for an orthopedic- 
ally disabled student, aged 15 years, and placed originally in a Special Day 
Class. 

Computation of Expectancies and Variance Estimates 

An interactive microcomputer program was developed to generate estimates 
of educational expectancies. Using the MAP 3x4x9x9 accounting framework 
of transition probabilities as the priir, " y data source, this program provides 
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Table 4 



Bd Ucatibnal Bxpectahc ie s for an -OrthopedicallY Disabled Student, 
iUw!15-Years^ and Placed OH in a^Special-Day Class* 

AT AGE 16 — i Year(s) Later 



Chances of Being — 

in a Special Day Class 42.1% 

in a Resource jProgram. 10. 5% 

in a Designated Instructional Service. ................ 15.8% 

in Some Other S.E. Setting. ........................... 5.3% 

in S.E. i Setting Uhkhown 5.3% 

in a Mainstream School Setting. ....................... 15.8% 

Dropped Out of School . 0% 

Graduated and at School or at Work 0% 

Graduated but Not at School or at Work 5.3% 

AT AGS 17 — 2 Year(s) Later 
Chances of Being — 

in a Special Day Class ............................... 17.8% 

in a Resource jProgram. 15 . 2% 

in a Designated Instructional Service. ................ 2.5% 

in Some Other S.E. Setting............................ 8.4% 

in S.E. i Setting Unknown 8.4% 

in a Mainstream School Setting 15.4% 

Dropped Out of School 3.2% 

Graduated and at School or at Work 16.1% 

Graduated but Not at School or at Work 13.2% 



AT AGE 18 — 3 Year(s) Later 



Chances of Being — 

in a Spect Day Class i 6.7% 

in a Sesctirce Program. .^^^ ... ^ ^ ............... 3.?% 

in a Desi£;n^ted Instructional Service. ................ 2.5% 

in Some Other S.E. Setting.....;...................... 3.1% 

in S.E. , Setting Unknown. ............................. 5.3% 

in a Mainstream School Setting. ....................... 0.3% 

Dropped Out of School 6.7% 

Graduated and at School or at Work 50.2% 

Graduated but Not at School or at Work. ............... 21. 7% 



These expectancies are based on data from one California SELPA. 
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Table 4 (cont'd) 



Educational Expectancies for an Orthopedically Disabled Student. 
Aged 15^ years i and Placed Criginally in a Special Day Class* 

AT AGS 3.^^ 4^ag(s ) Lat e r 



Chances of Being-- 

in a Special Day Class , 2.9% 

in a Resource Program. 1.6% 

^ P®^^??®^®^ instructional Service 1.4% 

in Some Other S.E. Setting. ... 1.4% 

in S.E. . Setting Unknown. 2.2% 

in a Mainstream School Setting. 0.3% 

Dropped Out of School 8.2% 

Graduated and at School or at Work. ................... 57.9% 

Graduated but N< u at School or at Work. 24.5% 

AT AGE 20 — 5 Year^ ) Later 



Chances of Being — 

ip. u Special Day Class... 1.2% 

in a Resource Program. 0.7% 

in a Designated Instructional Service p.7% 

in Some Other S.E. Setting. 0.6% 

in S.E^, Setting Unknown................... 1.0% 

in a Mainstream School Setting. 0.1% 

Dropped Out of School ................................. 8.9% 

Graduated and at School or at Work. 61.5% 
Graduated but Not at School or at Work. 25.7% 

AT AGE 21— 6 Yearn s) Later 



Chances of Being — 

in a Special bay Class 0.5% 

in a Resource Program. 0.3% 

in a Designated Instructional Service 0.3% 

in Some Other S.E. Setting. , 0.3% 

in S.B^, Setting Unknown................... p.4% 

in a Mainstream School Setting. p.1% 

!:*ropped but of school 9.2% 

Graduated and at School or at Work. 63 . 1% 
Graduated but Not at School or at Uovk. 26 .2% 



•^hese ibxpectancies are based on datr, from one ea?:iiforaia SELPA. 
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projections up to age 21 years from any starting age, for any of the three 
handicapping conditions and any of the instructional setting assignments 
specified by the framework. Figure 7 illustrates the functioning of this 
analysis program. 

To estimate the variance associated with the projected expectancies, a 
procedure modeled after that presented by Kish and Frarikel (1970) Was employed. 
Specifically, the pilot-test sample of 1099 students was randomly divided into 
halves ten times^ creating ten pairs of independent haif-san^ies (i.e., samples 
of 550 and 549 persons, respectively). Next^ expectancies were derived for 
each half-sample. The estimate of the variance of the expectancy e, based on 
the full sample, was then derived by the formula 

ri 

^ - JL a = (b - b. ) 

F 2 H 4n 

where h is equal to the number of pairs of estimates based on half-samples 
(b^j, b^2^* l,...,n. (A technical note describing the development of 
this formula is cbhtaihed in Appendix C.) The standard deviations for the 
probability estimates based on the whole population are presented in the 
figures to follow. 

Effect of Placement on Attainment 

Placement decisions involving special children are typically made based on 
the perceived needs of students and on available program offerings. Results of 
expectancy analyses provide information on program performance that can mean- 
ingfully inform this decisionmaking process. For exan4>le, when either a 
Special bay Class or Resource Specialist Prdgrgir* pl^cetaent might be advised 
for a student with a particular handicapping condition, expectancies allow 
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Oaerv#lr Age to start? 

Res^nse.#l! Single yj^ of age 

__. (e.g., 14 years) 

Agtiontf l ; Determine base-year age matrix for use wifli accounting framework 
(e.g., 12-15, 16, 17, 18-22). 



Query #2: Handicap? 

RgSPOnsg #2: Categog^ of handica^ing condition 

(e.g., ortfiopedic disabili^) 
Agtion #2; Select portion of accounting Jramewcric for this handicapping condition 

(e.g., four age-groups for this condition) 

Query #3: Individual or cohort analysis? 
Response #3: lorC 

Action #3: ft^aretorecdve irv' U vMus vosfer 

(e.g., zeroes jmd^ne^-jf 'T'; probability disttibuHon--if "G") 

, 4 ' 

Qflgry #4; Instructionai setting aSiignment(s) to stai d? 

Response #4: Type of setting(S) 
(e.g., SDC, DIS) 
Ac^on-#4. Greate input status vector. 



4 






Action #5: 


Multiply input status vector and base-year age 
matrix for selected porSon of framework. 




Aetibri #6- 


Ealeulate expectancies; 
Display expectancies; 

Define hew input status vector based on expectancies; 
_ Return to Action #5. 



Figure 7. Elustiative functional description of the MAP interactive sofiware 
program for estimating educational expectancies. 
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parents to see which type of program placement tends to lead to malnstreamihg 
in the shorter term. Simiiariy, given the age of the child, parents and schddi 
officials are able to compare the prospects of alternative placements for lead- 
ing to premature student withdrawals or to graduation. 

Figures 8-10 (Figures 8-25 appear at the end of this secbioh) present com- 
parisons of the mainstreaming probabilities associated with various instruc- 
tional placements for orthopedically disabled, learning disabled, and retarded 
or severely sensory disabled students aged 14 to 16 years. Figures 11-13 pre- 
sent similar comparisons of the drop-out probabilities >sociated with these 
placements. Finally ^ Figures 14-16 prcssent the graduation-at-schooi-or-work- 
prbbabilities associated with the three instructional placements for special 
students aged 15 to 18 years. 

Effect of Handicap oh Attainment 

Special education program administrators must design and conduct programs 
that offer sufficient breadth of activities to meet wide ranges of studen*. 
heeds. Within Special Day Class i Resource Specialist Program, and Designated 
Instructional Service settings ^ for exon^le, the preferred modes of instruc- 
tion will always involve adaptation of materials and presentation styles to 
individual abilities. 

Educational expectancies provide important measures ot how well programs 
are meeting special needs. For example, administrators can use expectancies 
to assess whether particular placements are resulting in returns to regular 
programs or drop-outs for certain types of students (e.g., those with learning 
disabilities). Similarly, teachers are able to measure how well they are doing 
in their classrooms in providing opportunities for graduation to all students. 
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Figures 17-19 present comparisons of the irainstreaming probabilities for 
brthbpedically disabled, learning disablGd, and retarded or severely sensory 
disabled students aged lA to 16 years who are assigned to different instruc- 
tional settings. Figures 20-22 present similar conqparisons of the drop-out 
probabilities for these disability groups. Figures 23-25 present graduation- 
at-school-or-work-probabiiities for ages 15 to 18 years. 
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Figure 8. Probability of being mainstreaihed by age 17: 
Orthopedic Disahititv 
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Figure 9. ProBability of being mainstreamed by age 17: 
Learning j>isability, 
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Figure 10. RtibabiUt/ of being mrinstreamed by age 17: 
Retardation/Severe Sensory Disabilitv. 
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Figure 1 1. Probability of dropping out by age 17: 
Qrthc ' 
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Probabilities 
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Figure 12. Probability of dropping out by age 17: 
Learning Usability. 
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^ i . R«!<Mirce Specialist Designatai Instructional 

CuiTcntAge Class Progiaih Service 



14 .22 .16 .19 

15 .07 .09 .13 

16 .00 .00 .0(5 



Standard Deviations 

.09 .05 .13 

15 .05 .03 .09 

16 .003 .03 .04 



Figure 13. Probability of droKjirig but by age 17: 
RetaidaHon/Severe Sensor y Disability. 
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Figure 14. Probability of graduating and being at school or 
at work by age 21: Orthopedic Disability. 
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Figure 15. ProlsabiUty of gnduating and being at school or 
at work by age 21: Learning Disability. 
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Figure 16. P^bbabili^ 
work b- 


i-a3uafing and being at school or at 
"■etardation/JSevere Sensorv Disahilitv, 
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Probabilities 



Orthop«iic Learning R^isjdatibn/Severc 

C jrentAge Disability Disability Sensory Disability 



14 .17 .32 .09 

15 .15 .25 .07 

16 .00 .13 .02 



Standard Deviations 

14 .06 .06 .04 

15 .06 .08 .04 

16 .03 .06 .03 



Figure 17. Probability of being mainstreamed by age 17: 
Special Davr:iass. 
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Figure 18. Probability of being maiiistreamed by oge 17: 
Resoufce S pecial ist ftogram. 
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Figure 19. Rrobability qf being mainstrcamed by age 17: 
Designated^nsmictiorial Sennch. 
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Figure 20. Probability of dropping out by age 17: 
Special Dav rla« 
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Figure 21. Probability of dropping out by age 17: 
Resource Specialist Program. 
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Figure 22. Probability of droppihg out by age 17: 

Dt^z7i:ited Inst nirtionai Seivice . 
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Figure 23. ProbabiUty of graduatihg and being at sc or at 
work by age 21: Special DayTTlas^s 
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1 24. Probability of graduating and bei if at school or at 
workbvaee21: Resource Speci aiist Program. 



-78- 



90 



nobebiuty 

ii 



6.9 

e.8 

0.7 
0.6 
05 
0.4 
03 
0.2 
0.1 




15 



_t_ 



IB 17 



IB 



LBarnLng Os. 
Ffetard/Sensopy Os. 



Probabiiities 



Gurrent Age 



Orthopedic 
Disabili^ 



Disability 



Retardation/Seyere 
Sensory Disability 



15 


.83 


.63 


.56 


16 


.74 


.68 


.60 


17 


.77 


.8i 


.64 


X8 


.74 


;76 


.57 






Standard Deviations 




IS 


.03 


.07 


.08 


16 


.06 


.08 


.€B 


17 


.12 


.10 


.14 


18 


.13 


.id 


.11 











25. I^bability of graduating and being at school or at 
work by age 21: Designated Instructional Servfe^ 



-79- 



91 



INTERPRETATION OF RESULTS AND RESEARCH RECOMMENDATIONS 



Both observed and estimated frequencies were used in deriving transition 
probabilities. As stated earlier, this approach was used to bolster the use- 
fulness of the relatively small sample size (1,099 students) in completing the 
3x4x9x9 MAP accounting framework. However, estimated values, which in 
s^^iT;© cases may be based on very few (e.g., less than ten) observations, provide 
less than adequate grounds for determining significance statistically. For 
this reason, it is, in general, best to regard the data presented in Figures 
8-25 as suggestive for further research on special education transitions. 

At issue also in the consideration of these dat i is the unavoidable 
confounding of the effects of handicapping condition and instructional setting 
assignment. Obviously* a special child should ba assigned to an instructional 
setting based upon the needs represented by Ms or her handicapping condition. 
The data presented in Figures 8-25 presumably reflect this assignment ••rule." 
If it appears, then, that students ^ith particular handicaps are mainscreamed 
with greater frequency vjhr^r^ j.L^.ad in particular instructional settings, 
remember that these original setting igtiments were based, at least in part, 
oh lEP team recof.niiioh of the recdiness of these students to be mains treamed. 
For this reason also, it is best to regard the data presented in Figures 8-25 
as suggestive for further research and not as prescriptive of preferrer ::ecting 
as&i:,;iments. 

Effec t of Piaceme^t on Attainnfent <^AKMres 8-lC) 

t igaiss 8, 1.^., and 14 show the efC^c^^^s of different placements on the 
f rojec^ied mfsinstr^^a^ing, dropping out, and graduation rates of studer.l^ <.\ the 
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secondary level with orthopedic disabilities. From these data, there are clear 
indications tha<: placement intc a Designated Instructional Service^ when 
possible, is advantageous for this group. First, orthopedically handicapped 
^tu(2dnts in DIS settings are more likely to be raainstreamed at age 17, ar?! hhi^: 
likelihood increases each year from 14 to 16 years o . Second, students 

with orthopedic disabilities have less chehce of ff^vi • :i.ropping out when placed 
in DIS settings . Third, these students' best chance for work or postsecondary 
edu lation follows gradu ^ ^rom this special educa^Jon setting. 

For the leeming disabled (Figures 9, 12, and 15), there is no one setting 
that consistently leads to desirable outcomes more th-^n the others — i,e,, the 
settings perform con^arably in terms of providing mainstreaming opportunities , 
preventing early withdrawal before graduation (i.e., drop-out), and promoting 
work or postsecondary education attainments. Retarded students and those with 
severe sensory disabilities also seem to fare similarly following placements 
into any of the three settings (Figures 10, 13, and 16). 

It is interesting to noibe, however, that SDC placements for retarded and 
severely sensory-disabled students seem slightly advantageous for work or 
Xs>ostsecdhdary education following graduation, according to these data (i.e.. 
Figure 16). This type of finding is in contrast to conclusions drawn 
tentatively by Hasazi, Gbrdbh, and Roe (1985). These researchers suggested 
tha more severely handicapped students in special^ contained classrooms were 
likely to miss much of the vocational preparation and training activities 
associated with less restrictive settings, arid were therefore more likely to 
hot be employed following graduation. The possibility that the increased 
specialization provided by contained, all-day classes might be of assistance 
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to refcarded (and severely seris6t-|f-i: -..jled) graduates when they leave the high 
school isetting should be examined more carefully. 
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Figures 8-13 (with one exception) reflect hh:-^ giv^^v r n DHp^sct of stutlent 
mobility oat of special education at later ages when : .ley were enrolled in spe- 
cial education classes at earlier ages (eg, projected mainstream and drop-out 
rates are higher for ages 14 or 15 than zli^y are for age 16). Once a child 
reaches age 16^ if he or she is enrolled in special education, hPt or she is 
likely to remain in special education until graduation. 

The exception (in Figure 8) occurs in the case of the orthopedically dis- 
abled, who, if assigned to a Designated T'^structional Service, are mores likely 
to return to the regular program at age 17 with each passing year, from age 14 
to 16 years. The orthopedically handicapped also seem more at risk than the 
other handicapping groups with respect to dropping out of rchooi at age 17 
When placed in either a Special Day Class or a Resource Specialist Program at 
an early age (Figure 11). Perhaps the all-day, contained, and highly special- 
ized ert^/ironments represented by these settings lead to feelings of alienation 
among ihts student group during their most '"impressionable" ^-^eriod. 

Effect of Handicap on Attainment (Figures 17-25) 

in general, thj three special education instructional settings tend to 
achieve best results for students with learning disabilities. These students 
can expect to be mainstreamed with greater frequency (with one exception — see 
Figure 19), to graduate, and to find *irork or educational opportunitiess follow- 
ing graduatidh. The retarded, and those students with severe sensory disabil- 
ities fare less well across these instructional settings. This group may 
continue to present the most challenging proHiems to special educator.;. 
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The brthbpedically disabled fare little better than the retarded, although 
their performance as a result of assignment to a Designated Instructional Ser- 
vice is exceptional. Figures 19, 22, and 25 describe these positive results. 
At the same time, however. Special bay Classes seem to be struggling somewhat 
in their efforts to assist these students (Figures 17, 20, 23). 

Assignment to a Designated instructional Service augurs well for being 
mainstreamed into the regular program at age 17 for all three handicapping 
conditions, as the probabilities of being mainstreamed at that age increase or 
remain stable for younger students B^rd 14 to 16 years (save for a slight drop 
occurring st age 15 for learning dij?:. ^ied students). Unlike SDC or RSP 
settings* wherein the older the sti: nt the less chance of his or her being 
mainstreamed at age 17* OIS settinjscr continue to offer these mainstreaming 
opportunities through age 16. 

Finally, Figurer 23-25 pose eoveral questions worthy of more detailed 
r'Ti? js>rch efforts at the micro-level. In many ways* these data ;3peak to the 
pre-eminent areat- of concern to special educators, the transitions from 
school to work, postsecondary education, and independent living. 

First, from Igure 23, which aspects of SDC settings seem to be affecting 
retarded and severely sensory-disabled student? positively, in terms of post- 
graduation attainments? At the same time, which aspects of these settings 
seem to be affecting orthopedically hahdir^pped students negatively? Why are 
these students less likely to be at work or in school following graduation 
from SDC assignments than students with other disabilities? 
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Seco, . , from Figure 24, which aspects of RSP programs might account for 
the lack of success of retarded aand severely sensorif -.disabled students fdilow- 
ihg their graduation from these programs? (Intbrestingly , this finding also 
conflicts with the conclusions of Hasazi, Gordon, & Row, 1985.) Ta particular, 
why the sudden and sharp drop in post graduation prospects for these studants 
from age 16 to 17 years? 

Third, from Fiijure 25, w~iic>i -*>*iects of DIS programs could be made more 
effective for retard- v i se*- -jr iy sensory-disabled students? Are the older 
students (age 18 years) among this group receiving less benefit from DIS assis- 
tance than the younger 5;tudents (ages 15-17 years)? Which aspects of DIS pro- 
grams night be impt^oved cr strengthened to ensure equal benefits? 

Areas for Further Study 

Project HAP — Model Accounting Plan — will engage xn three major areas of 
further study in Year Two that are designed to address critical research 
issues and to solidify and extend Year One findings. These areas and their 
associated products are docjcribed below. 

Area li Delineation of the AccQuntinK Framework 
The 3x4x9x9 MAP accounting framework rnist be refined so that sharper 
discriminations may be made among in-schv. .-'"s and p.Ds'z-graduation out- 

comes. Following the suggestions of Bclla;a ' ^<i7'' ^ id Edgar (1985), which 
indicate needs for further studios on more narrowly-def .\ned fipecfal education 
populations, Projt. t MAP will aim to include vocational prc^ram of: rings and 
specific types (or subcategories) of DIS services in the Yv^ar Two accmnt.ing 
framework. In addition* post-graduation earnings, levels of heed, and levels 
of assistance received from community agencies should be included in the 



framework* Such expansion, however » requires the establishment of a larger 
database « if the resulting estimates are to be reliable. 

fn Year Two, Project MAP wtii expand its database from one-disferi^^^ 
twelve, thereby increasing the numbers o f student records from 1,000 to more 
than ten tim e s 4hat h ilmb e r . The framework will be expanded to include subcate- 
gories of bis services, and the follow-up of recent-year graduates will attempt 
to make use of social security numbers to obtain earnings data. In addition to 
this work, data tapes will be collected and MAP procedures will be established 
in six additional SELPAs in Gaiifbrnia, in preparation for the expansion of 
the MAP database to seven SELPAs (and more than 60*000 students) in Year Three 
of the project. 

Area 11^- Stabilit y^f Trans ition Pr obab^il-iti^s 
The single-stage transition probabilities that are the basis for the 
findings presented in this report must be compared to similar measures for the 
period 1986-1987 if Ibheir stability over time is to be assessed. Stability, in 
this context, refers to the constancy of the transition estimates from one pair 
of years to the next, an assumption underlying computation of the expectancy 
estimates presented above. While extensive changes; in school policies reiaibing 
to special education may be expected to affect these rates for any new period, 
it is important that the rates not fluctuate erratically dlie to extraneous 
variation, to assess stability, the 3x4x9x9 MAP accounting framework 
must be used to compute transition estimates for a new period (e.g., December 
i986-becember 1987), and tests of the similarity of these estimates to those 
presented in this report must be made. 
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In Year Two, Project HAP will compute tre:i9ib4on-^roba&ilifei#s— fer fche 
p eriod becerober i936-becenibek: j.987. in the same secondary schooi dls4riefc— fehat 
participated in th^ Taar One study, usihg the 3x4x9x9 accoanting -fe^me^ 
worfe. The similarity of transition probability estimates will be compared 
aiid presented in the Year Two final report. In addition, the replication of 
MAP procedures iri this district will provide a second-stage test of the data 
preparation and analyssis steps outlined in an earlier section of the present 
report . 

Area III: Institutionalization of MAP Procedures 
For Project HAP to achieve its goal of widespread adoption of accounting 
procedures by special education jurisdictions, these procedures roust be able to 
be institutionalized in these jurisdictions. Institutionalization requires 
that staff persons iri local agencies be willing and able to carry out all data 
collection and analysis tasks with only minimal support. Because the Hodel 
Accounting Plan builds on the annual pupil-count of special education piartici- 
pants, it introduces few additional data coilecition burdens. The follbw-up of 
recent-year graduates, for example, which is the single new data collection 
requirement, is designed to be carried but using existing staff resources. 
What is heeded most to promote local use of the MAP accounting framework — 
particularly the analysis routines — is locally available computer support, 
capable of carrying out the required data organization and analysis tasks. 

In Yea r Two, Prci e ct ^iap wi ll b e gin d e v e l opmeht-of a micrbcbmputer-based 
management information system for spe<^ ial edu ^atloa^at wiH f e atur e trahsi - 
tionai analysis capabilities , Horeover, this system will include ah interac- 
tive planning aid, which will function as a "what if" tool, allowing local 
administrators to estimate the outcomes of their programs for students with 
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various disabilities. Work on development of the £.ystem will take place in a 
second Califoria SBLPA^ and pilot testing of the system will be scheduled for 
early spring 1987. 
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APPBVDIX A: 
MAP FOLLOW-UP QUBSTIOmUilRB 



Notes 



Student Name: 



o Student (Named Above) 

o Friend 

o Other Student 

o Spouse 

Residence : 

o Not Known 



o Parent or Guardian 
o Other Family Member 
o Ocher: 



Same Address (Refer) 

to file) 

New Address 

b In Area 

o Out of Area 



Employment/Education Status 

o Not i^own 

o Not Empibyed 

o Military 

o Homemaker 

o (Other) Empibyed 

o Fuii-Time 

b Part-Time 

b Receives Regular Pay, 

at the jbb site (nbt 
Sttbsidissed employment) 



o Not Enrolled 

o Enrolled 

o Fuii-Time 
b Part-Time 
School Name: 



Receipt of Agency Assistance or Vocational Services 

o Not Known o Not Received/ 

Not Receiving 



A--1 



log 



-2- 



Received Assistance/ Recaives Assistance 
Advice/infcrmation on a Regular Baais 

Dept. of Rehabilitation b o 
E»!splpyment Development Dept. 

(or State Job Service) 6 o 

Social Security b b 
Welfare/Social or Mental Health 

Services (Not Vocational) d b 
Vocational Services/Training 

(Specify Below, if Possible): o d 

Adult Independence Devel* Gtr. o 0 

Apprenticeship in California o o 

Community Assoc. for the Retarded b o 

Cbmmunity Mainstreaming Program b o 

Fbbd Service Training (De Anza) b b 

6b bdwill b b 

Hope Rehabilitation Service b b 

Inst, of Computer Technology b b 

MC Jobs b b 

No. County Regional Occ. Program d b 

Occupational Training Inst. d o 

Project Hired d o 

San Andreas Regional Center d d 

Other: 

6 o 

b b 
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APPEITDIX B: 
OBSBRVBD AITD BSTIMATBD FRBQUENCiBS* 



OBSERVE 



Orthopedic bisabtlxty, A^e 12--15 Years 



0 


b 


b 


b 


b 


b 


b 


6 


0 


d 


b 


e 


b 


b 


b 


b 


0 


0 


1 


0 


5 


b 


d 


id 


2 


0 


0 


0 


D 


0 


0 


d 


d 


d 


b 


0 


6 


0 


0 


0 


0 


D 


d 


0 


b 


0 


i 


15 


6 


6 


90 


D 


0 


0 


0 


0 


0 


6 


6 


0 


1 


0 


d 


b 


b 


6 


6 


0 


6 


0 


1 


0 


b 


b 


b 


b 


b 


6 


0 


0 


1 



Orthopedic Disabxlxtv. Age 16 Years 



i 


d 


b 


b 


b 


b 


b 


0 


6 


d 


2 


b 


d 


b 


b 


b 


0 


b 


d 


d 


2 


d 


b 


12 


b 


0 


b 


0 


d 


d 


d 


d 


b 


b 


b 


b 


0 


0 


0 


0 


d 


1 


0 


b 


b 


6 


6 


0 


0 


0 


81 


0 


d 


d 


0 


6 


0 


6 


0 


q 


1 


d 


d 


b 


0 


6 


6 


6 


0 


0 


1 


0 


b 


b 


0 


0 


6 


0 


0 


0 


1 


pedic 


Disability. 


Age 17 


-Years 












b 


b 


b 


0 


0 


6 


0 


0 


0 


b 


b 


b 


b 


0 


b 


0 


0 


0 


b 


i 


b 


b 


b 


1 


0 


0 


0 


b 


b 


b 


b 


0 


b 


0 


0 


0 


d 


d 


b 


d 


b 


b 


0 


0 


0 


d 


d 


b 


d 


b 


36 


3 


31 


3 


D 


0 


d 


d 


0 


d 


1 


b 


b 


0 


0 


0 


d 


0 


d 


d 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


1 



^Marginal headings for the 3x4x9 x ) matrix are the same as those shown in 
Figure 6 . One-year-to-the-nestt transition probabilities for the HAP account- 
ing framework (pp. 52-54). Please refer to that figure for description of 
these headings. 
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APPENDIX C: 
VARIANCE HSTIHATBS FOR EXPECTANCY MEASURES, 
A TECHNICAL NOTE 

For n pairs C^j^j.* ^£2^' i=l,**.,n9 of estimates based on half-san^les^ 
variance of the half-sample estimates is twice the variance of the full-san^)! 
estimate. 

The variance of the half-san^le estimate has an unbiased estimate: 

H(i) i 

The valaes b^^ are the averages of the half-sainple estimates. They should be 
on the average, close to the fuii-santpie estimates. 

d can be rewritten as follows: 
H(i) 

= (b.,- hi ^ ^i2 )^ + Cb.,- \l ^ ^2 )^ 

H(i) ^^2 ^^2 

= -|- ^^1 - h2>' 

With n pairs ^ these terms are added: 
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Finally, the estimate of the variance of the full-san^le estimate is: 
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